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Tsallis nonextensive entropy both in the full and half spaces. The rates of convergence 
to the exact Levy stable distributions are determined by taking the A'^-fold convolutions 
of these distributions. The marked difference between the problems in the full and half 
spaces is elucidated analytically. It is found that the rates of convergence depend on the 
ranges of the Levy indices. An important result emerging from the present analysis is 
deduced if interpreted in terms of random walks, implying the dependence of the 
asymptotic long-time behaviors of the walks on the ranges of the Levy indices if A'^ is 
identified with the total time of the walks. 



1. Introduction 

There is growing interest in Levy-type random walks and anomalous diffusion 
phenomena. They are often encountered in many physical systems, including polymer- 
like breakable micelles dissolved in salted water [1], tracer particles in rotating flow [2], 
subrecoil laser cooling of atoms [3], two-particle dispersion in fully developed 
turbulence [4], and single molecule line shape cumulants in glasses [5]. (See also Refs. 
[6-8].) To describe and understand these phenomena physically and mathematically, it 
seems necessary to generalize the framework of traditional statistical mechanics. For 
example, it was pointed out [9-14] that introduction of Riemann-Liouville fractional 
calculus [15] to the diffusion and Fokker-Planck equations can lead to solutions of the 
Levy-type distributions (though not the exact Levy distributions). Another organizing 
principle to understand such phenomena was based on the method of maximizing the 
Boltzmann-Shannon entropy for extensive systems. It was found in Ref. [16] that, in 
order to obtain Levy distributions using this method, one has to impose a constraint 
which does not admit a natural physical interpretation. The main reason for this 
unsatisfactory state of affairs is due to the divergent second moment of Levy-type 
distribution. Recently, Tsallis [17] introduced an alternate to the Boltzmann-Shannon 
entropy to treat nonextensive systems [18,19]. It was soon realized [20-24] that this 
form of the entropy can satisfactorily incorporate situations where divergent first few 
moments of the distribution occur. In this approach, a power-law distribution is derived 
as the maximum Tsallis entropy state. It has the same asymptotic behavior as the exact 
Levy distribution for large values of the relevant random variable, and therefore its 
lowest moments diverge. In the language of random walks, this optimal distribution 
may describe a single jump, and thus, after A'^ -jumps (i.e., A/^-fold convolution), it is 
expected to converge to the exact Levy stable distributions in the large- A'^ limit. 
Considering A'^ as the total time of the walks, such a limit implies the long-time 



behaviors of the walks. The idea behind this is the Levy-Gnedenko generalized central 
limit theorem [25,26], which states that by A'^-fold convolution a distribution with 
divergent lowest moments tends to one of the Levy stable class of distributions in the 
limit N ^ oo if such a limit is convergent. However, the convergence has not been 
discussed in the previous works [20-24]. 

Now, associated with the convergence property, there is also an important issue 
regarding the rate of convergence . This is actually a generic physical problem related to 
the limiting theorems in probability theory. For example, in Ref. [27], a truncated Levy 
distribution, i.e. a Levy distribution whose long tail cut off, was studied numerically. 
Since such a distribution has a finite second moment, the relevant mathematics there is 
the ordinary central limit theorem, that is, convergence of the distribution to a Gaussian 
distribution by many-fold convolution. The authors of Ref. [27] discovered an intersting 
fact that convergence of the truncated Levy distribution to a Gaussian distribution is 
extraordinarily slow. This result tells us that there is an essential difference between 
Levy-type and non-Levy-type distributions in a finite space. 

The purpose of the present paper is two-fold: First, to study the rate of convergence 
of the maximum Tsallis entropy distribution to the exact Levy distribution. In particular, 
we consider this problem in full space {-°°, °°), which was not addressed in Refs. [20- 

24]. Second, to examine the derivation of the exact Levy distribution in half space 
(O, °°) by this method, which has not been discussed in the literature. The half-space 

problem is very different from the full-space one and has important physical 
implications. Specifically, the half space analysis is required for Hamiltonian systems 
whose spectra are bounded from below. The rate of convergence is also clarified in the 
half-space case. We analytically determine the corrections to the exact Levy stable 
distributions in terms of the number of times of convolution. We shall show that, quite 
remarkably, the rates of convergence depend the ranges of the Levy indices in the cases 
of both the full and half spaces. 



The paper is organized as follows. In Sec. 2, the rate of convergence of the 
maximum Tsallis entropy distribution to the exact Levy distribution is studied in the 
full space. Then, in Sec. 3, we formulate the Levy problem in the framework of the 
principle of maximum Tsallis entropy in the half space as well as determine the rate of 
convergence. Section 4 is devoted to conclusions. 



2. Maximum Tsallis entropy distribution in full space 

A complete derivation of the maximum Tsallis entropy distribution in the full space 
(-00, oo) within the framework of the normalized q-expectation value formalism [28] 

was given in Ref. [24]. The authors of Ref. [24] considered the optimization of the 
Tsallis entropy 



^>]=Y^ jfM-r-iL (1) 



under the constraints on the normalization condition 



dxp{x) = \, (2) 

and on the generalized second moment defined in terms of the normalized ^-expectation 
value 

j dxx^P^{x) = a\ (3) 



where a is a positive constant giving a length scale and P^ix) is the escort 
distribution [29] associated with p{x), i.e., 



PAx) = 



bW]' 



j dx'[p{x')]' 



(4) 



q in eqs. (1) and (4) is the entropic index, which is assumed to be 



<q<3 



(5) 



for the problem of a Levy-type distribution. The maximum Tsallis entropy distribution 
was then found to be [24] 



p{x) 



1 a-l 



^ 1 ^ 



a^|^{3-q) ^ 



3-q ^r „ 1 ..2 A 



y2q-2j 



1 + 



(7-I .)C 
3-^ (T 



1/(9-1) 



(6) 



where r(z) is the Euler gamma function. It is noted that this distribution has the 
divergent ordinary second moment, dxx^p{x) = °°, but the generalized second 

moment in eq. (3) is finite. For large values of x, the above distribution asymptotically 
behaves as 



p{x) ~ X 



-2/(9-1) 



(7) 



On the other hand, the exact symmetric Levy distribution in the full space [25,26] 



L^{x) = — dk exp[-ikx)expi-a\k\^\ 



(8) 



has the following asymptotic form: 



L^{x)~x-'-\ (9) 



where a is a positive constant and 7 the Levy index satisfying 

0<7<2. (10) 

Let us examine the convergence properties of the distribution in eq. (6) to the exact 
Levy distribution L^{x) in view of the generalized central limit theorem [25,26]. First 

of all, comparing eq. (7) with eq. (9), q is expected to be related to the Levy index as 

follows: 



«=^. (11) 

1 + 7 



In order to apply the theorem, it is necessary to consider the sum of N scaled random 
variables {^,};_j 2 l w' ^^^^ ^^' 






X. {i = 1, 2, L , A^) and X respectively take the values x- andx, which run over whole 
of real numbers. X/s are assumed to be independently and identically distributed. The 
distribution of X is essentially given by A'^-fold convolution. The scale factor 5^ has 

to be chosen in such a way that the limit distribution is independent of the number A'^ 
of convolutions. Suppose each X. obeys the Levy distribution in eq. (8). Then, the 

distribution of X is given by 

LfW = 54L,*L *L^){B,x), (13) 



where the convolution in the full space reads 



(/*^)W= j dx'f{x-x')g{x'). 



(14) 



To see the above-mentioned independence, we employ the standard method of 
characteristic functions. The characteristic function of I^y\x) is calculated to be 



X[^\k)=] dx exp{ikx) L'^^^x) 
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where xA^) i^ the characteristic function of L {x): 



Xi^{k) = &xp[-a\k\']. 



(16) 



Therefore, we have 



B =N^'^ 



(17) 



where, without loss of generality, the constant of proportionality is set equal to unity. A 
set of limit distributions JL^(.)c): < 7 < 2| forms a stable class. 

To examine the convergence properties of the distribution in eq. (16) by many-time 
self-convolutions, again we calculate its characteristic function. After some 
manipulations, we find 



X{k) = dx exp{ikx) p{x) 






(18) 



where K ^{z) is the modified Bessel function [30] and 
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A = (tV2v. 
Clearly, the range of v is 
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0<v<l. 



(21) 



Next, let us discuss the limit N ^o° of the quantity 
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For this purpose, it is convenient to take its logarithm, that is. 
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Using the formula [30] 
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where I^{z) is the Bessel function of imaginary argument, and evaluating the series 
expansion [30] 
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we have 
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Thus, we find that, in the limit N ^°o, the maximum Tsallis entropy distribution in 
fact converges to the exact symmetric Levy distribution with 
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(27) 



Now, from the above analysis, we also find the rate of convergence. From eq. (26), it 
follows that the decay of the correction to the exact Levy distribution in the large- A'^ 
limit behaves in two different ways depending on the range of the Levy index: 



0(n-') (0<7<1), (28) 



0(n'-^"') (1<7<2). (29) 



Therefore, we conclude that the convergence is slower for 1 < 7 < 2. 



3. Maximum Tsallis entropy distribution in half space 

It is known [26] that the properties of probability distributions defined in the half 
space (0, 00) are quite different from those in the full space (-00, 0°). Physically, such 

distributions are important in cases where the basic random variables describing 
systems are bounded from below. A typical example is the Hamiltonian of a stable 
system. So far, the maximum Tsallis entropy approach to study of Levy-type 
distributions has not been discussed in the half space. In this section, we provide such a 
demonstration in parallel with the discussion in the previous section. We shall use for 
the half-space problem the same notation as for the full space, but it should not cause 
any confusion. 

Analogously to eq. (1), the Tsallis entropy in the half space is given by 

^,b] = j^|jf[^M^r-i}- (30) 

We maximize this quantity under the constraints on the normalization condition 
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^dxp{x) = l, (31) 



and on the generalized first moment defined in terms of the normalized ^-expectation 
value 

{X)^=] dxxP^{x)^a, (32) 



where X is the basic random variable which takes a positive real value x. Here, Pg{x) 
is the escort distribution in the half space 



PW = J£WL. (33) 



j dx[p{x)]' 



The resulting distribution is found to be 

1 r , , /- / \/ ^ii/(i-?) 

p{x) 



ZM 



l-{l-qp/c^)(x-{X)^) 



(34) 



where Z^ (jS) is the normalization constant, jS = jS/a "^ ^ with /? the Lagrange 
multiplier associated with the constraint in eq. (32) and 

c^=^ dx [p{x)] * . (35) 



A long-tailed distribution is realized for q>l. The normalizability condition requires 

poo 

q<2. In addition, the divergence of the ordinary first moment, dxxp{x) = o°, 
places another condition q > 3/2 . Therefore, the range of interest is 
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<Q<2. 



(36) 



c^ and {X) are the quantities, which have to be calculated by using p{x). In what 

follows, we determine these quantities self-consistently. The normalization condition on 
p{x) leads to the identical relation 



K(^)] 



\-q 



(37) 



Let us rewrite eq. (34) in the form 



p{x) = 



m) 



{q-^)P 
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1 



(^+^) 
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(38) 



where 



^ = 






(39) 



From eqs. (38) and (40), consistency requires that ^ be positive. This point will be 
ascertained subsequently. Using the distribution in eq. (38), we have the following 
result: 



{X) =%- 



(40) 



This is a relation of crucial importance for obtaining the self-consistent solution. From 
it, it is clear that ^ in eq. (39) is in fact positive, as promised above. Thus, the 
maximum Tsallis entropy distribution in the half space is written in the form 
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p{x) = ^^ 
q-\ 



l-Q ^(2-q)/(g-l) 



(^ + ^) 



l/(?-l) 



(41) 



The distribution of this type is often referred to as the Zipf-Mandelbrot distribution in 
the literature. Substituting eq. (41) into eq. (32), we have 



^ = tCT. 

q-1 



(42) 



Consequently, we obtain the following distribution: 



pix) 
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Next, let us recall the exact Levy distribution L^{x) in the half space [26]. It is 
defined as follows: 



1 f 
L{x) = ^—\ dkexp{-ikx)xLik), 

2n •' 



(44) 



Xi (k) = exp\ -a\k\''' exp 



i£{k) 



Gn 



(45) 



where a is a positive constant, 7 the Levy index, a constant satisfying 1 1 < 7 and 
£{k) = k l\k\ the sign function of k.ln contrast to the case of the full space, the range 
of the Levy index in the half space is 



0<7<1. 



(46) 
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This distribution has the following asymptotic behavior for large values of x : 

L^{x)~x-'-\ (47) 

poo 

and therefore the ordinary first moment is divergent: dx x L^{x) = o° . 

Comparing eq. (47) with the asymptotic form of eq. (43), we expect the following 
relation between q and the Levy index: 



2 + y 
q = -^. (48) 

1 + 7 



As in the case of the full space, JL^(;c): < 7 < l} forms a stable class. To see this, 

we again consider the scaled sum of independently and identically distributed A'^ 
positive random variables {^, > 0},^j 2 l ^^^^^^^^^ 



X = ^1 + ^2+L X^ 



Each X. {i = 1, 2, L , A^) is assumed to obey the exact Levy distribution L^{x) in eq. 

(44). The scaling factor 5^ is chosen in such a way that the limit distribution is 

independent of the number A'^ of convolutions. The distribution of X is given by A^^- 
fold convolution of L^{x): 

L\''\x)^B^(l^*L *L^){B,x), (50) 

where the convolution here is defined by 

X 

{f*g){x) = l dx'f{x-x')g{x'). (51) 
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The characteristic function of D '{x) is calculated to be 



X[''\k) = ] dx exp{ikx) L^^\x) 



Xi 



' k^ 



K^NJ 



(52) 



(In calculating the inverse Fourier transformation, note that L^{x) = for x<0.) 
Thus, we find that the exact Levy distribution is invariant under A/^-fold convolution if 



B, = N 



i/r 



(53) 



Now, we are in a position to discuss how the maximum Tsallis entropy distribution 
p{x) in eq. (43) converges to the exact Levy distribution in eq. (44) in accordance with 
the generalized central limit theorem. For this purpose, we again consider the 
characteristic function of p{x), which is calculated as follows: 



X{k) = dx exp{ikx) p{x) 
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where M[a, b; z) is the Kummer function [31] with the expansion 



M{a,b\z) = \ + -z + —^ f — + L . 

^ ' b b{b + \)2\ 



(55) 



The quantity to be considered is 
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Taking the logarithms of both sides of this equation, we have 
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where we have used eq. (48). Performing the expansion for large 'N , we find 
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Therefore, from eqs. (45) and (58), we may identify 



a = (7CT)''r(l-7), 



(59) 
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= -/. (60) 

The rate of convergence to the exact Levy distribution for large A^ can be 
determined from eq. (58). We find the behavior analogous to the case of the full space 
in Sec. 2: 

0(n-') (0<7<1/2), (61) 

0{a^ '"'"') (1/2<7<1). (62) 
Thus, we conclude that the convergence is slower for 1 / 2 < 7 < 1 . 



4. Conclusions 

We have derived the Levy-type distributions, their convergence to the exact Levy 
stable distributions and its rates both in the full and half spaces based on the principle of 
maximum Tsallis nonextensive entropy. This has been done by considering the A'^-fold 
convolutions of the distributions arising from the use of the above principle in 
conformity with the Levy-Gnedenko generalized central limit theorem. A new result 
emerging from this analysis is that the rates of convergence depend on the ranges of the 
respective Levy indices. This result interpreted in terms of random walks implies that 
asymptotic long-time behaviors of the (Tsallis) walks depend on the ranges of the Levy 
indices if A'^ is regarded as the total time of the walks. We have also elucidated the 
marked difference between the problems in the full and half spaces analytically. 
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